SoniMime: Movement Sonification for Real-Time Timbre Shaping
نویسندگان
چکیده
This paper describes the design of SoniMime, a system for the sonification of hand movement for real-time timbre shaping. We explore the application of the tristimulus timbre model for the sonification of gestural data, working toward the goals of musical expressivity and physical responsiveness. SoniMime uses two 3-D accelerometers connected to an Atmel microprocessor which outputs OSC control messages. Data filtering, parameter mapping, and sound synthesis take place in Pd running on a Linux computer.
منابع مشابه
Sonimime: Sonification of Fine Motor Skills
This paper describes the design of SoniMime, a system for the sonification of hand motion. Among SoniMime’s applications is the use of auditory feedback to refine fine motor skills in a wide variety of tasks. Our primary sonification method involves mapping movement to timbre parameters. Specifically, we explore the application of the tristimulus timbre model for the sonification of gestural da...
متن کاملNeuroklang : Real-time Timbre Control using Neural Networks
Neuroklang is a video-based interface for the sonification of hand gestures for real-time timbre control. Neuroklang is being used to make computer-based instruments with interactive control. It also allows the musicians to create sonorous and visual compositions in real time. The system consists of a laptop's camera, the filtering of camera input via the open source software known as Processin...
متن کاملAn Interface for Live Interactive Sonification
Sonification is generally considered in a statistical data analysis context. This research discusses the development of an interface for live control of sonification – for controlling and altering sonifications over the course of their playback. This is designed primarily with real-time sources in mind, rather than with static datasets, and is intended as a performative, live data-art creative ...
متن کاملTONAL DisCo: DISSONANCE AND CONSONANCE IN A GAMING ENGINE
Whilst there are several existing toolkits specifically designed for sonification, there has been little investigation into the utilization of computer game engines for sonification. This paper will demonstrate the implementation of a real time game engine for the purpose of sonification and discuss the opportunities and limitations. An important aspect which is lacking in existing sonification...
متن کاملGenerating an Integrated Musical Expression with a Brain-Computer Interface
Electroencephalography (EEG) has been used to generate music for over 40 years, but the most recent developments in brain–computer interfaces (BCI) allow greater control and more flexible expression to use new musical instruments via EEG. We developed a real-time musical performance system using BCI technology and sonification techniques to generate chords with organically fluctuating timbre. W...
متن کامل